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DETAILED ACTION 
Election/Restrictions 

Applicant's election without traverse of Group I (claims 1-90) in the reply filed on 
January 10, 2005 is acknowledged. Because applicant did not distinctly and specifically 
point out the supposed errors in the restriction requirement, the election has been 
treated as an election without traverse (MPEP § 818.03(a)). 

Claims 91-100 are withdrawn from further consideration pursuant to 37 CFR 
1.142(b) as being drawn to a nonelected invention, there being no allowable generic or 
linking claim. Election was made without traverse in the reply filed on January 10, 
2005. 

Claim Objections 

Claim 66 is objected to because of the following informalities: In claim 66, on line 
3, "configured determine" is ungrammatical. (changing this to "configured to determine" 
would cure this problem). Appropriate correction is required. 

Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 41-54 and 77-90 are rejected under 35 U.S.C. 101 because the claimed 
invention is directed to non-statutory subject matter. A computer software program 
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product is non-statutory subject matter (changing this to "computer-readable medium 
encoded with a computer program" would cure this problem). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1,11, 26-28, 36-38, 41 , 42, 50-52, 55, 64-66, 72-74, 77, 78, and 86-88 
are rejected under 35 U.S.C. 103(a) as being unpatentable over the applicant's 
admitted prior art in view of Lundsgaard (U.S. Patent 4,997,769) and further in view of 
Ohta (U.S. Patent 5,835,617). 

As to claim 1 , The background of the instant application discloses determining an 
amount of at least one molecular specie comprising a sample (page 1 , line 7), each 
molecular specie being indicated by a dye (page 3, line 24), from an image of the 
sample captured as image data by a color image acquisition device in a video- 
microscopy system (page 5, lines 15-16 and 30). The background of the instant 
application also discloses obtaining data in each of a red, green and blue channel, for 
pixels in the image (page 6, lines 2-5). 

The background of the instant application does not expressly disclose 
determining an optical density of the sample from the image data so as to form a 
corresponding optical density matrix for the pixel; and multiplying the optical density 
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matrix by an inverse of a relative absorption coefficient matrix so as to form a resultant 
matrix for the pixel, the relative absorption coefficient matrix comprising a relative 
absorption coefficient for each dye, independently of the sample, in each of the red, 
green, and blue channels, the resultant matrix comprising the amount of each molecular 
specie, as indicated by the respective dye, for the pixel. , 

Lundsgaard discloses determining an optical density of the sample from the 
image data; and dividing the optical density by the absorption coefficient so as to form a 
resultant, the absorption coefficient obtained, independently of the sample (column 2, 
lines 44-45 - here the absorption coefficients are predetermined and are therefore 
considered to have been obtained independently), in each of the channels (column 2, 
lines 46-47 - here image data at each individual wavelength is equivalent to a channel), 
the resultant comprising the amount of each molecular specie (column 2, line 33 - here 
concentration is determined, which is equivalent to the amount of the specie). 
Lunsgaard discloses what is shown overall above, by showing the use of Lambert- 
Beer's law (column 1, lines 31-36). As concentration is the term being solved for 
(column 1 , lines 32-33), the other terms are must be being determined prior to solving. 
Note that this is equivalent to the equation used in the instant application (page 12, 
equation 1), as absorbance and optical density are equivalent terms in this case. The 
equation can then be rearranged so as to show that the amount of molecular specie is 
obtained by dividing the optical density by the absorption coefficient, as shown in the 
instant application (page 24, line 9). When dealing with matrices, instead of division, 
multiplying by the inverse is used, as is well known in the art. While Lundsgaard does 
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not expressly disclose the use of matrices, the use of matrices for equation calculations 
on computers is well known. { 

It would have been obvious to a person of ordinary skill in the art, at the time the 
invention was made, to use Lambert-Beer's law as disclosed in Lundsgaard when 
processing the image data from each of the color channels in the applicant's admitted 
prior art as they both deal with finding concentrations of biological components in a 
specimen. This would result in improved identification of optical density of the sample 
and/or dye, thus providing motivation. 

The combination of the applicant's admitted prior art and Lundsgaard as applied 
above does not expressly disclose the use of a relative absorption matrix in Lambert- 
Beer law calculations. 

Ohta discloses the use of a relative absorption coefficient matrix (column 12, 
lines 51-55) in Lambert-Beer law calculations. 

It would have been obvious to a person of ordinary skill in the art, at the time the 
invention was made, to use a relative absorption coefficient matrix as in Ohta when 
calculating the amount of a molecular specie as in the applicants admitted prior art and 
Lundsgaard, as they both involve Lambert-Beer law calculations. Doing so would 
provide a basis for more accurate comparison of data from different color channels, thus 
providing motivation. 
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As to claim 14, as to use of a counterstain, the examiner takes official notice that 
use of a counterstain is well known in the art of microscopy. It would have been 
obvious to a person of ordinary skill in the art to use a counterstain as they are 
commonly used to color the components in a microscopic specimen that are not made 
visible by the principal stain, thereby improving the visibility of those components. 

As to claims 26, 41 , 55, 64 and 77, the limitations of the claims are rejected for 
the same reasons as in the rejection of claim 1 . 

As to claim 1 1, the applicants admitted prior art as modified above, further 
discloses capturing an image of the sample as image data in each of the red, green, 
and blue channels of at least one of an RGB camera and an RGB-configured scanner 
(page 2, line 18 and page 6, lines 1-2). 

As to claim 27, the limitations of the claim are rejected for the same reasons as in 
the rejection of claim 11. 

As to claim 28, Lundsgaard as applied above, further discloses determining an 
initial intensity of a light emitted by a light source (column 1 , line 49) in each of the red, 
green, and blue channels (values at specific wavelengths of light are able to be 
determined as shown in column 1, lines 40-41). 
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As to claims 36, 37 and 38, Lundsgaard as applied above further discloses 
computer storage media and processors (column 4, lines 17-20) used for calculating 
concentration (column 4, line 14). The more detailed aspects of the calculations such 
as involving relative absorption coefficients and matrices have been discussed in the 
rejection of claim 1 and the aspects involving doing these calculations for the dyes have 
been discussed in the rejection of claim 2. 

As to claims 50, 51 and 52, the limitations of the claims are rejected for the same 
reasons as in the rejections of claims 36, 37 and 38 respectively. 

As to claims 72, 73 and 74, the limitations of the claims are rejected for the same 
reasons as in the rejections of claims 36, 37 and 38 respectively. 

As to claims 86, 87 and 88, the limitations of the claims are rejected for the same 
reasons as in the rejections of claims 36, 37 and 38 respectively. 

As to claim 42, the applicants admitted prior art as modified above further 
discloses a computer directing a light source to illuminate the sample with a light having 
an initial intensity in each of the red, green, and blue channels (page 2, lines 19-22 
indicate automated light control and page 6, lines 1-2 discuss RGB channels). 
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As to claim 78, and the limitations of the claim are rejected for the same reasons 
as in the rejection of claim 42. 

As to claim 65, the applicants admitted prior art as modified above, discloses a 
light source directed toward the RGB camera (page 6, lines 9-1 1 - if an image is 
captured by the RGB camera, then light must be directed towards it) and configured to 
emit a light having an initial intensity in each of the red, green, and blue channels (see 
the rejection of claim 42). 

As to claim 66, the examiner takes official notice that it is well known in the art to 
illuminate a microscopy sample with light when capturing its image with a camera. It 
would have been obvious to a person of ordinary skill in the art to illuminate a 
microscopy sample as good lighting is required for accurate color imaging and 
illumination would therefore enable a more accurate image. Regarding determining an 
optical density being further configured determine a transmitted intensity of the light 
transmitted through the sample in each of the red, green, and blue channels of the RGB 
camera, see the rejection of claims 1 and 43. 

Claims 12, 13, 24, 25, 39, 40, 46, 53, 54, 68, 75, 76, 89, and 90 are rejected 
under 35 U.S.C. 103(a) as being unpatentable over the combination of the applicant's 
admitted prior art and Lundsgaard and Ohta as applied to claims 1, 14, 26, 41, 55, 64 
and 77 above, and further in view of Krasieva (U.S. Patent 5,734,498). 



Application/Control Number: 09/957,446 Page 9 

Art Unit: 2623 

As to claim 12, the combination of the applicant's admitted prior art and 
Lundsgaard and Ohta does not expressly disclose illuminating the sample under 
Koehler illumination conditions. 

Krasieva discloses disclose illuminating the sample under Koehler illumination 
conditions (column 7, line 48). 

It would have been obvious to a person of ordinary skill in the art, at the time the 
invention was made, to use Koehler illumination as in Krasieva for illuminating the 
sample in the combination of the applicant's admitted prior art and Lundsgaard and 
Ohta as they both involve examining specimens by microscope and doing so would 
ensure ample light for illuminating the sample as taught by Krasieva (column 5, lines 21- 
22). 

As to claims 24, 39, 53, 75 and 89, the limitations of the claims are rejected for 
the same reasons as in the rejection of claim 12. 

As to claim 13, the combination of the applicant's admitted prior art and 
Lundsgaard and Ohta does not expressly disclose correcting chromatic aberration in the 
video-microscopy system. 

Krasieva discloses correcting chromatic aberration in the video-microscopy 
system (column 1 1 , lines 53-54). 

It would have been obvious to a person of ordinary skill in the art, at the time the 
invention was made, to correct for chromatic aberration as in Krasieva when imaging 
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specimens as in the combination of the applicants admitted prior art and Lundsgaard 
and Ohta as they both involve color imaging of specimens by microscope and doing so 
would reduce the amount of inaccuracies in the images. 

As to claims 25, 40, 54, 76 and 90, the limitations of the claims are rejected for 
the same reasons as in the rejection of claim 13. 

Claims 2-10, 15-23, 29-35, 43-49, 56-63, 67-69, 70, 71, and 79-85, are rejected 
under 35 U.S.C. 103(a) as being unpatentable over the combination of the applicant's 
admitted prior art and Lundsgaard and Ohta as applied to claims 1 , 14, 26, 41 , 55, 64 
and 77 above, and further in view of Stone (U.S. Patent 6,819,787). 

As to claim 2, the combination of the applicants admitted prior art and Lunsgard 
and Ohta, as applied above, discloses the use of a relative absorption coefficient matrix 
instead of just an absorption coefficient matrix (see rejection of claim 1). 

The combination of the applicants admitted prior art and Lunsgard and Ohta, 
does not expressly disclose determining the relative absorption coefficient for each dye, 
independently of the sample, in each of the red, green, and blue channels. 

Stone discloses determining the absorption coefficient for each dye (column 8, 
lines 43-44 and 56 show that the absorption coefficient of the dyes are determined), 
independently of the sample (column 6, line 47 - non-tissue area means independent of 
the tissue sample), in each of the red, green, and blue channels (column 6, lines 45-46). 



Application/Control Number: 09/957,446 Page 1 1 

Art Unit: 2623 

It would have been obvious, for a person of ordinary skill in the art, at the time the 
invention was made, to determine the absorption coefficients of each dye independent 
of the sample as in Stone, when calculating the amount of a molecular specie as in the 
combination of the applicant's admitted prior art and Lundsgaard and Ohta, as they both 
process microscopy images of stained biological samples. Doing so would enable the 
effects of the dye to be subtracted from the overall image, leaving only the effects of the 
sample, thus providing motivation. 

As to claim 15, Stone further discloses conducting the above-mentioned 
calculations for a second stain present in the sample (column 8, lines 56-57). The 
counter stain is considered to be a second dye/stain in the sample. All other limitations 
are rejected for the same reasons as in the rejection for claim 2. 

As to claim 56, the limitations of the claim are rejected for the same reasons as in 
the rejection of claim 2. 

As to claim 3, 16 and 57, the limitations of the claims are rejected for the same 
reasons as in the rejection of claim 28. 

As to claim 4, Stone as applied above, further discloses illuminating each dye 
with the light source, independently of the sample (column 6, lines 45-48 show that the 
background areas are being illuminated - these are the areas where only the dyes are 
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present, independent of any tissue), and determining a transmitted intensity of the light 
transmitted therethrough in each of the red, green, and blue channels (column 6, 
equation 1 on line 63). 

As to claims 8, 17, 21, 29, 32, 46, 58, 68 and 82, the limitations of the claims are 
rejected for the same reasons as in the rejection of claim 4. 

As to claim 5, the combination of the applicant's admitted prior art and 
Lundsgaard and Ohta does not expressly disclose comparing the initial intensity of the 
light to the transmitted intensity of light so as to determine an optical density for each 
dye in each of the red, green, and blue channels. 

Stone as applied above, further discloses comparing the initial intensity of the 
light to the transmitted intensity of light so as to determine an optical density for each 
dye in each of the red, green, and blue channels (column 8, lines 62-67). 

It would have been obvious for a person of ordinary skill in the art, at the time the 
invention was made, to use initial intensity and transmitted intensity of light to determine 
optical density of each dye as in Stone, when calculating the amount of a molecular 
specie as in the combination of the applicant's admitted prior art and Lundsgaard and 
Ohta, as they both process microscopy images of biological samples stained with dyes. 
Doing so would enable the effects of the dye to be subtracted from the overall image, 
leaving only the effects of the sample, thus providing motivation. 
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As to claims 9, 18, 22, 30, 33, 44, 47, 62, 69 and 83, the limitations of the claims 
are rejected for the same reasons as in the rejection of claim 5. 

As to claim 6, Stone as applied above, further discloses determining an optical 
density for each dye by determining a natural logarithm of a ratio of the initial intensity of 
the light to the transmitted intensity of the light in each of the red, green, and blue 
channels (see rejection of claim 5 and column 9, lines 26-31). 

As to claims 10, 19, 23, 31, 34, 45, 48, 59, 63, 67, 70, 81 and 84, the limitations 
of the claims are rejected for the same reasons as in the rejection of claim 6. 

As to claim 7, the examiner takes official notice that it is well known in the art to 
normalize the optical density in each of the red, green, and blue channels, with respect 
to the channel having the highest optical density. 

It would have been obvious for a person of ordinary skill in the art, at the time the 
invention was made, to normalize the channel optical density data with respect to the, 
channel exhibiting the highest optical density, in the data for each dye, as determined in 
the combination of the applicants admitted prior art and Lundsgaard and Ohta and 
Stone. This would allow for more accurate data comparison between channels, thus 
providing motivation. 
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As to claims 20, 35, 49, 60, 71 and 85, the limitations of the claims are rejected 
for the same reasons as in the rejection of claim 7. 

As to claim 43, Stone as applied above, further discloses a computer directing a 
measurement (column 5, line 48) of a transmitted intensity of the light transmitted 
through the sample in each of the red, green, and blue channels (column 9, lines 16-19 
and column 8, lines 48-50). 

As to claim 61 , and the limitations of the claim are rejected for the same reasons 
as in the rejection of claim 66. 

As to claim 79, and the limitations of the claim are rejected for the same reasons 
as in the rejection of claim 43. 

As to claim 80, the combination of the applicants admitted prior art and 
Lundsgaard and Ohta does not expressly disclose determining an optical density is 
further capable of comparing the initial intensity of the light to the transmitted intensity of 
the light so as to determine an optical density for the sample in each of the red, green, 
and blue channels of the RGB camera. 

Stone as applied above discloses that determining an optical density is further 
capable of comparing the initial intensity of the light to the transmitted intensity of the 
light so as to determine an optical density (column 8, lines 63-67) for the sample in each 
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of the red, green, and blue channels of the RGB camera (column 9, lines 26-29 - here 
optical density for every point in the image is calculated, which therefore includes the 
sample). 

It would have been obvious for a person of ordinary skill in the art, at the time the 
invention was made, to use initial intensity and transmitted intensity of light to determine 
optical density of a sample as in Stone, when calculating the amount of a molecular 
specie as in the combination of the applicant's admitted prior art and Lundsgaard and 
Ohta, as they both process microscopy images of biological samples stained with dyes. 
Doing so would enable optical density to be calculated, thereby allowing the amount of 
the sample to be more accurately measured, thus providing motivation. 

Contact Details 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ashutosh Upreti whose telephone number is (571) 272- 
7428. The examiner can normally be reached on Monday-Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (571) 272-7414. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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